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We construct a large class of non-Markovian master equations tliat describe the dynamics of open 
quantum systems featuring strong memory effects, which relies on a quantum generalization of the 
concept of classical semi-Markov processes. General conditions for the complete positivity of the 
corresponding quantum dynamical maps are formulated. The resulting non-Markovian quantum 
processes allow the treatment of a variety of physical systems, as is illustrated by means of various 
examples and applications, including quantum optical systems and models of quantum transport. 
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The analysis of the time evolution of open systems 
plays a central role in many applications of modern 
quantum theory, including quantum information science, 
quantum transport theory, quantum thermodynamics, 
and quantum process tomography and control (see e.g. 

The state of an open quantum system that is cou- 
pled to the degrees of freedom of its surroundings is rep- 
resented by a time-dependent density matrix p{t) . In the 
Markovian regime the dynamics is governed by a master 
equation of the relatively simple form 



-p{t) = Cp{t), 



(1) 



where Cis a time-independent generator with the famous 
Gorini-Kossakowski-Sudarshan-Lindblad structure [2] 



Cp^-z[H,p]+J2 



AapAi- -{AlAa,,p} 



(2) 



The Hamiltonian H describes the coherent part of the 
time evolution and the A^ are certain operators repre- 
senting the various decay modes. The solution of Eq. ^ 
can be written in terms of a linear map V{t) = exp(£t) 
that transforms the initial state p{0) into the state p{t) = 
V{t)p{0) at time t. The physical interpretation of this 
map V{t) requires that it preserves the trace and the pos- 
itivity of the density matrix p{t). According to general 
physical principles V{t) must be a completely positive 
(CP) map [IjSl- Hence, V(t) represents a CP dynami- 
cal semigroup known as quantum Markov process, whose 
generator has been proven :2] to be of the form ([2]). 

The quantum dynamics given by Eq. ([2]) has a clearcut 
connection to a classical Markov process for the case in 
which one has a closed system of equations for the pop- 
ulations Pn{t) — {n\p{t)\n) in a fixed orthonormal basis 
{\n)} of the open system's Hilbert space, typically the 
energy eigenbasis. In fact, in this case one recovers the 
Pauli master equation, 



i-P-m (^) 



^Pn{t)], 



(3) 



which describes a classical Markovian jump process with 
transition rates r„j„, justifying the notion of a quantum 
Markov process. 

The most important physical assumption which under- 
lies the master equation ^ is the validity of the Markov 
approximation of short environmental correlation times. 
If this approximation is violated non-Markovian dynam- 
ics emerges which is characterized by pronounced mem- 
ory effects, finite revival times and non-exponential re- 
laxation and decoherence. These effects can result from 
long-range correlation functions, from correlations and 
entanglement in the initial state, as well as from the ne- 
glection of extra degrees of freedom affecting the dynam- 
ics Q . As a consequence the theoretical treatment of 
non-Markovian quantum dynamics is generally extremely 
demanding. A widely used non-Markovian generalization 
of Eq. ID) is given by the integrodifferential equation 



d , , 



dTK:{T)p{t-T). 



(4) 



In this equation one takes into account quantum memory 
effects through the introduction of the memory kernel 
/C(t) which means that the rate of change of the state 
p{t) at time t depends on the states p(t — t) at previous 
times t — T. Equations of the form ^ arise, for instance, 
by employing the standard Nakajima-Zwanzig projection 
operator technique Q • Obviously, the Markovian master 
equation ([1]) is obtained if the memory kernel is taken to 
be proportional to a (5-function, JC{t) — 2S{t)C. 

In order to be physically acceptable the superopera- 
tor IC(t) appearing in Eq. ([4]) must grant the CP of the 
resulting quantum dynamical map V{t). This is a very 
stringent requirement and, in fact, the general structural 
characterization of physically admissible memory kernels 
is an unsolved problem of central importance in the field 
of non-Markovian quantum dynamics [1] . It has been 
realized recently that even the most simple and natural 
choices for the memory kernel can lead to unphysical re- 
sults . To improve this situation we will construct a 
class of non-Markovian quantum master equations that 



2 



arises naturally as a quantum mechanical generalization 
of classical semi-Markov processes The approach 

proposed here leads to important physical insights guid- 
ing the phenomenological determination of the memory 
kernel, and, at the same time, enables a compact formula- 
tion of sufficient conditions that guarantee the existence 
and the CP of the quantum dynamical map. Moreover, 
for a specific class of processes one can formulate CP con- 
ditions which are not only sufficient but also necessary. 
We consider memory kernels with the general structure 



IC{r)p = -z[i?(r),p]-i5]{At(r)A„(r),p} 

a 



(5) 



that is to say of the form given by Eq. ^ apart from the 
time dependence of the considered operators. As pre- 
viously done in the Markovian case let us consider the 
situation in which the populations obey a closed system 
of equations of motion, which then takes the form 



dt 



PJt) 



-W^niT)Pn{t~T) , (6) 



where Wnm{T) — J2a \ {''^\Aa{T)\m)\'^ . This is the master 
equation for a general type of classical non-Markovian 
processes known as semi-Markov processes Thus, 
whenever the populations obey closed equations, Eq. ([2|) 
yields the classical Markovian master equation ([3]), while 
Eq. (HI) with the kernel (O leads under the same condi- 
tions to the generalized master equation (O for a classical 
semi-Markov process. This justifies on the same footing 
as before the name quantum semi-Markov process. 

To clarify the physical content of Eq. © let us consider 
as an example the situation in which the kernel functions 
Wnm {t) factorize as Wnm (t) {t), where 7r„m > 

and '^^TTnm = 1- The corresponding process can then 
be interpreted as describing a particle moving on a lattice 
with sites labelled by n, where the 7r„m are the proba- 
bilities for jumps from site m to site n. Jumps out of a 
given site n take place after a certain waiting time t that 
follows the waiting time distribution fn{t). The charac- 
teristic feature of semi-Markov processes is the fact that, 
by contrast to the Markovian case, /„(t) need not be an 
exponential function, but can be any probability distri- 
bution, thus giving rise to memory effects. These waiting 
time distributions are uniquely determined by the func- 
tions kn{t) according to the relation [11 1 



fn{t) = I dTkn{T)gn{t - t) = (fc„ * gn){t), (7) 

Jo 



where the function 



gn{t) = 1- / dT/„(T) 
Jo 



(8) 



denotes the probability not to have left site n by time t, 
the so-called survival probability, and * is the usual con- 
volution product. The generalized master equation Q 
therefore provides a physically acceptable time evolution 
for the populations Pn{t)i granting in particular their 
positivity, provided the functions kn{t) allow an inter- 
pretation in terms of waiting time distributions 11 , 13] ■ 
However, these classical conditions are clearly not 
enough to ensure the existence of a well-defined dynam- 
ics in the quantum case, and a general characterization 
at the quantum level can hardly be achieved. Therefore 
our next goal is the formulation of sufficient conditions 
that guarantee the CP of the dynamical map V{t) corre- 
sponding to the non-Markovian master equation defined 
by Eqs. (j4]) and ([5]), no longer assuming that closed equa- 
tions for the populations exist. This map is defined by 



dt 



V{t) 



dTlC{T)V{t 



(9) 



together with the initial condition V{0) = I, with / the 
identity map. We now employ ideas recently formulated 
in Ref. [l^ . decomposing the memory kernel as JC{t) = 
B{t) + C{t), where B{t) is the CP map defined by 



B(r)p^^^„(r)pAt.(r), 



(10) 



and C(t) is given by the first line of ([S]). We further 
introduce the map Vo{t) as the solution of the equation 

±Voit)^ J^dTC{T)Vo{t-T), (11) 

with the initial condition Vb(0) ~ I. Considering the 
Laplace transforms of Eqs. ^ and pT|) one obtains a 
resolvent-like identity for the dynamical map leading in 
the time domain to the equation 



V{t) = Vo{t) + {Vo*B*V){t). 



(12) 



Regarding formally the superoperator B(t) as a pertur- 
bation and iterating Eq. one finds that the full dy- 
namical map V{t) can be represented as a series. 



Vit) = Voit) + {Vo*B*Vo)it) 

+ {Vo* B *Vo* B *VQ){t) 



(13) 



Due to the fact that the set of CP maps is closed under 
addition and convolution, we can conclude from Eq. p3|) 
that V{t) is CP if Vait) is CP. To bring this condi- 
tion into an explicit form let us assume that the Her- 
mitian operators H{t) and J^a Aai''')Aa{T) are diagonal 
in the time- independent orthonormal basis that is 

H{t) = I]„en(T)|n)(n| and 



^Al(r)A„(r)=5]fc„(r)|n)(n|. 



(14) 
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Then we can solve Eq. ((TT|) to obtain 

Voit)p{0) = ^5„„(i)|n)(n|p(0)|m)(m|, (15) 

nm 

where the functions gnm{t) are the solutions of 



gnni(t) = - dr [Znir) + Z*^{t)] gnrnit - t), (16) 

Jo 

corresponding to the initial conditions .9,11,1(0) = 1, and 
Zn{T) — ^kn{T) + ie„(T). To provc Eq. p5)) one first 
shows that C{t) (|n)(m|) = -[z„(t) + z;;(r)]|n)(m|. Us- 
ing this relation one easily demonstrates that the ex- 
pression psp indeed represents the desired solution of 
Eq. pTjl . It is important to notice that the functions 
gnn{t) do actually coincide with the survival probabili- 
ties gn{t) introduced by Eq. ([8]). 

Employing the Kraus representation Q we see that 
the map Vo(t) given by Eq. ITS)) is CP if and only if the 
matrix with elements g.nm{t) is positive, 



G{t) = (g„™(i)) > 0. 



(17) 



Hence, we arrive at a sufficient condition for CP: The 
quantum dynamical map V{t) corresponding to the non- 
Markovian master equation (j4|) with the memory ker- 
nel (O is CP if the condition ((T7|) is fulfilled. A nec- 
essary condition for p?)) to hold is the positivity of the 
diagonal elements of G{t), which are given by the survival 
probabilities gn{i) = gnn(t). This necessary condition in 
turn implies the positivity of the functions /„(i) accord- 
ing to Eq. (Ill), which can then be interpreted as true 
waiting time distributions. The positivity of the matrix 
G{t) therefore represents a natural quantum generaliza- 
tion of the classical conditions. 

We illustrate the result (flT)) with the help of sev- 
eral examples, which all fall into the class of quantum 
semi-Markov processes introduced by means of Eqs. (jl]) 
and ([5|). A prototypical system showing strong non- 
Markovian behavior is a two-level atom interacting with 
a damped field mode described by the memory kernel 



/C(r)p 



-ie(T)[cr+cr-,p] 



+k{T) 



(18) 



Excited and ground state are denoted by |-|-) and |— ), 
respectively, and a± are the corresponding raising and 
lowering operators. The index n thus takes on the two 
values n — ±. For a positive function fc(r) the memory 
kernel (|18p is of the form specified above with A;+(t) = 
A:(t), fc_(T) — 0, e+(T) = £(t), and e-(T) = 0. Hence, 
the matrix G{t) takes the form 



G{t) = 



9*+-it) 1 



(19) 



with g++{t) and g+-{t) determined by Eq. (fTB)) . Thus 
we see that the condition ((T7)) for CP is equivalent to 
g++{t) > \9+-{t)\^- The master equation corresponding 
to the memory kernel (fTS]) can be solved analytically. 
One then finds that for this case the condition (|17p is 
not only sufhcient but also necessary for CP. 

A further very instructive example involving an infinite 
dimensional Hilbert space is the model of a quantum os- 
cillator with non-Mar kovian damping studied in Ref . . 
The memory kernel for this model reads 



IC{t)p — klr) 



apa' 



(20) 



where ^(t) = Kexp(— 7r) and a\ a are the raising and 
lowering operators of the oscillator. This kernel is again 
of the form ^ with a single Lindblad operator A{t) = 
y/k{T)a. Here, the basis states |n) are the number states 
of the oscillator, fc„(T) = nfc(r) and e„(r) = 0. Solving 
Eq. (|16p by means of a Laplace transformation, we find 



5mi(i) 



= e-7*/2 



cosh(d„i/2) + -f- smh{dnt/2) 



where d,, = (7/2)^ — tik. For the necessary condition 
gnn{t) > to hold dn must be real. This shows that 
condition ^T7\ is certainly violated if Auk > 7^. Because 
n can be arbitrary large we conclude that condition (jl7p 
is never fulfilled. The interesting aspect of this example is 
the fact that the non-Markovian master equation indeed 
violates not only CP but also positivity. This fact has 
been demonstrated in Q and clearly shows again the 
relevance of our CP conditions. 

Many further physical systems lead to a generalized 
master equation of the form introduced here if one ap- 
plies the Nakajima-Zwanzig projection operator tech- 
nique, such as the tight-binding quantum diffusion model 
studied in [14|| , and the quantum transport model intro- 
duced in 15| , which leads to a memory kernel of the form 



IC{t)p — k^r) 



TpT^ + \t^ pT - p 



(21) 



This kernel describes the motion of an excitation in a 
modular system consisting of weakly coupled subunits 
labelled by the index n, where T = X),, I"- + 
represents the corresponding translation operator. The 
model features strong non-Markovian behavior and a 
transition from diffusive to ballistic quantum transport. 
The memory kernel /C(t) is obviously of the form intro- 
duced above. The Hamiltonian contribution vanishes, 
H{t) = 0, and all kernel functions are equal to each 
other, kn^r) = ^{t), which corresponds to the special 
case treated in Refs. [5i, [13] with a loss term proportional 
to the identity operator. Equation (fTH]) shows that also 
all matrix elements of G(t) are equal, gnm(t) = g{t), and, 
hence, condition (fT7)) reduces to the condition g{t) > 0. 
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Clearly this condition leads to important restrictions on 
the form of the kernel function /c(t) which is determined 
by the correlation function of the microscopic model. 

As our final example we discuss memory kernels of the 
following general structure, 

1C{t)p = -^[i^(r),p]-l^fc„(r){|n)(n|,p}, 

+ ^7r„™fc„(r)|n)(m|p|m)(n| (22) 

nm 

of which ()18|) provides an example. For this memory 
kernel the coherences of the density matrix, i. e. the 
off-diagonal elements Pnm{t) = {n\p(t)\m) , n ^ ra, are 
simply given by pnni{t) = Pnm(0)5„m(i). On the other 
hand, the diagonals of the density matrix, i. e. the popu- 
lations Pn{t) obey a closed transport equation as in ([6]). 
It is remarkable that in this case one can go one step 
further to derive a condition for the CP which is not 
only sufficient but also necessary. To this end one writes 
the quantum dynamical map V{t) corresponding to the 
non-Markovian quantum master equation ([4]) with the 
memory kernel \22\ in terms of the functions gnm (t) and 
of the conditional transition probabilities Tnm (t) obeying 
the classical master equation ([5]). The quantity T„rn{t) 
represents the probability that the particle is at site n 
at time t given that it started at site m at time t — 0. 
With the help of the resulting expression for the map 
V{t) we then find the following result. Given a classical 
semi-Markov process, the quantum dynamical map V{t) 
is CP if and only if the condition 

G{t) - ignrnit)) > (23) 

is satisfied. Here, the off-diagonal elements of the matrix 
G{t) coincide with those of G{t), while the diagonals of 
G(t) are given by the conditional transition probabilities, 
dnnit) = Tnn{t). Notc that the probabilities Tnn{t) are 
in fact in general greater than the corresponding survival 
probabilities gnnit), since the system can be in state n 
at time t both because it has not left it and because it 
has come back to the initial state. Eq. ([23]) thus pro- 
vides a complete characterization of the CP of the class 
of quantum semi-Markov processes given by (|22p . 

Building on an analogy with classical semi-Markov pro- 
cesses we have constructed a large class of non-Markovian 
master equations with memory kernel and formulated 
sufficient conditions for the CP of the resulting quantum 
dynamical map. The latter impose strong restrictions 
on the structure of physically acceptable non-Markovian 
quantum master equations, which are particularly useful 



in phenomenological approaches. For a specific class of 
quantum semi-Markov processes necessary and sufficient 
conditions for CP have also been formulated. Important 
further developments of the theory should include the 
case of temporarily negative kernel functions and effects 
from correlations and entanglement in the initial state. 
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